AFRL-RV-PS- 

TR-2014-0113 


AFRL-RV-PS- 

TR-2014-0113 


ADAPTATION  IN  MULTI-SATELLITE 
CONSTELLATION  COOPERATION 


Chengyu  Cao 


University  of  Connecticut 
Department  of  Mechanical  Engineering 
191  Auditorium  Road,  Unit  3139 
Storrs,  CT  06269 


1  Aug  2014 


Final  Report 


APPROVED  FOR  PUBLIC  RELEASE;  DISTRIBUTION  IS  UNLIMITED. 


AIR  FORCE  RESEARCH  LABORATORY 

Space  Vehicles  Directorate 

3550  Aberdeen  Ave  SE 

AIR  FORCE  MATERIEL  COMMAND 

KIRTLAND  AIR  FORCE  BASE,  NM  87117-5776 


DTIC  COPY 

NOTICE  AND  SIGNATURE  PAGE 


Using  Government  drawings,  specifieations,  or  other  data  included  in  this  document  for 
any  purpose  other  than  Government  procurement  does  not  in  any  way  obligate  the  U.S. 
Government.  The  fact  that  the  Government  formulated  or  supplied  the  drawings, 
specifications,  or  other  data  does  not  license  the  holder  or  any  other  person  or  corporation; 
or  convey  any  rights  or  permission  to  manufacture,  use,  or  sell  any  patented  invention  that 
may  relate  to  them. 


This  report  is  the  result  of  contracted  fundamental  research  deemed  exempt  from  public  affairs 
security  and  policy  review  in  accordance  with  SAF/AQR  memorandum  dated  10  Dec  08  and 
AFRL/CA  policy  clarification  memorandum  dated  16  Jan  09.  This  report  is  available  to  the  general 
public,  including  foreign  nationals.  Copies  may  be  obtained  from  the  Defense  Technical 
Information  Center  (DTIC)  (http://www.dtic.mil). 


Qualified  requestors  may  obtain  copies  of  this  report  from  the  Defense  Technical 
Information  Center  (DTIC)  (http://www.dtic.mil). 


AFRL-RV-PS-TR-2014-01 13  HAS  BEEN  REVIEWED  AND  IS  APPROVED  EOR 
PUBEICATION  IN  ACCORDANCE  WITH  ASSIGNED  DISTRIBUTION  STATEMENT. 


//SIGNED// 
KHANH  PHAM 
Program  Manager 


//SIGNED// 

PAUL  HAUSGEN 

Technical  Advisor,  Spacecraft  Component  Technology  Branch 


//SIGNED// 

BENJAMIN  M.  COOK,  Lt  Col,  USAF 
Deputy  Chief,  Spacecraft  Technology  Division 
Space  Vehicles  Directorate 


This  report  is  published  in  the  interest  of  scientific  and  technical  information  exchange,  and  its 
publication  does  not  constitute  the  Government’s  approval  or  disapproval  of  its  ideas  or  findings. 


Approved  for  public  release;  distribution  is  unlimited. 


REPORT  DOCUMENTATION  PAGE 


Form  Approved 
0MB  No.  0704-0188 


Public  reporting  burden  for  this  coliection  of  information  is  estimated  to  average  1  hour  per  response,  including  the  time  for  reviewing  instructions,  searching  existing  data  sources,  gathering  and  maintaining  the 
data  needed,  and  completing  and  reviewing  this  coliection  of  information.  Send  comments  regarding  this  burden  estimate  or  any  other  aspect  of  this  coilection  of  information,  inciuding  suggestions  for  reducing 
this  burden  to  Department  of  Defense,  Washington  Headquarters  Services,  Directorate  for  Information  Operations  and  Reports  (0704-0188),  1215  Jefferson  Davis  Highway,  Suite  1204,  Arlington,  VA  22202- 
4302.  Respondents  shouid  be  aware  that  notwithstanding  any  other  provision  of  iaw,  no  person  shali  be  subject  to  any  penalty  for  failing  to  compiy  with  a  coilection  of  information  if  it  does  not  display  a  currently 
valid  OMB  control  number.  PLEASE  DO  NOT  RETURN  YOUR  FORM  TO  THE  ABOVE  ADDRESS. 


1 .  REPORT  DATE  (DD-MM-YY)  2.  REPORT  TYPE  3.  DATES  COVERED  (From  -  To) 

01-08-2014  Final  Report  26  Apr  2013  -  17  Jul  2014 


4.  TITLE  AND  SUBTITLE  5a.  CONTRACT  NUMBER 

Adaptation  in  Multi-Satellite  Constellation  Cooperation 

FA9453- 13- 1-0287 

5b.  GRANT  NUMBER 


7.  PERFORMING  ORGANIZATION  NAME(S)  AND  ADDRESS(ES) 

University  of  Connecticut 
Department  of  Mechanical  Engineering 
191  Auditorium  Road,  Unit  3139 
Storrs,  CT  06269 


9.  SPONSORING  /  MONITORING  AGENCY  NAME(S)  AND  ADDRESS(ES) 

Air  Force  Research  Laboratory 
Space  Vehicles  Directorate 
3550  Aberdeen  Ave.,  SE 
Kirtland  AFB,  NM  87117-5776 


12.  DISTRIBUTION  /  AVAILABILITY  STATEMENT 

Approved  for  public  release;  distribution  is  unlimited. 


5c.  PROGRAM  ELEMENT  NUMBER 

61102F 


5d.  PROJECT  NUMBER 

3003 


5e.  TASK  NUMBER 

PPM00015448 


5f.  WORK  UNIT  NUMBER 

EFO 10907 


8.  PERFORMING  ORGANIZATION  REPORT 
NUMBER 


10.  SPONSOR/MONITOR’S  ACRONYM(S) 

AFRL/RVSV 


11.  SPONSOR/MONITOR’S  REPORT 
NUMBER(S) 

AFRL-RV-PS-TR-20 14-0113 


14.  ABSTRACT 


This  report  details  a  method  of  determining  the  optimal  reference  trajectory  for  a  controlled  agent.  The  reference  trajectory  is  chosen 
assuming  that  the  system  begins  in  steady  state  and  the  objective  is  to  minimize  control  effort.  The  report  includes  the  motivation  for  this 
design,  a  derivation  of  the  algorithm,  and  simulation  results.  Based  on  the  trajectory  optimization  of  a  single  agent,  distributed  adaptation 
will  be  applied  for  a  multi-agent  network,  e.g.  satellite  constellations. 


15.  SUBJECT  TERMS 

Autonomous  space  systems,  Fligh  fidelity  satellite  simulator,  multi-objective  optimization 


16.  SECURITY  CLASSIFICATION  OF: 

a.  REPORT 

Unclassified 

b.  ABSTRACT 

Unclassified 

c.  THIS  PAGE 

Unclassified 

17.  LIMITATION 

18.  NUMBER 

OF  ABSTRACT 

OF  PAGES 

Unlimited 

16 

Khanh  Pham 


19b.  TELEPHONE  NUMBER  (include  area 
code) 


Standard  Form  298  (Rev.  8-98) 

Prescribed  by  ANSI  Std.  239.18 


(This  page  intentionally  left  blank) 


Approved  for  public  release;  distribution  is  unlimited. 


TABLE  OF  CONTENTS 


Section  Page 

1.0  SUMMARY . 1 

2.0  INTRODUCTION . 1 

3.0  METHODS,  ASSUMPTIONS,  AND  PROCEDURES . 1 

3 . 1  Problem  Eormulation . 1 

3 .2  Reference  Optimization . 1 

3.3  Control  Algorithm . 2 

3.3.1  State  Predictor . 2 

3.3.2  Adaptive  Eaw . 2 

3.3.3  Control  Eaw . 3 

3.4  Extension  to  Multi- Agent  Systems . 3 

4.0  RESULTS  AND  DISCUSSION . 5 

5.0  CONCLUSIONS  AND  RECOMMENDATIONS . 6 

5.1.  Conclusions . 6 

5.2.  Recommendations . 6 

LIST  OE  SYMBOLS,  ABBREVIATIONS,  AND  ACRONYMS . 8 


Approved  for  public  release;  distribution  is  unlimited. 


(This  page  intentionally  left  blank) 


Approved  for  public  release;  distribution  is  unlimited. 


1.0  SUMMARY 


This  report  details  a  method  of  determining  the  optimal  reference  trajectory  for  a  controlled 
agent.  The  reference  trajectory  is  chosen  assuming  that  the  system  begins  in  steady  state  and  the 
objective  is  to  minimize  control  effort.  The  report  includes  the  motivation  for  this  design,  a 
derivation  of  the  algorithm,  and  simulation  results.  Based  on  the  trajectory  optimization  of  a 
single  agent,  distributed  adaptation  can  be  applied  for  a  multi-agent  network,  e.g.  satellite 
constellations. 

2.0  INTRODUCTION 

In  many  control  applications,  such  as  satellite  orbit  stabilization,  fuel  savings  are  an  important 
consideration.  Furthermore,  every  real  system  is  subject  to  uncertainties  and  disturbances.  In 
the  presence  of  uncertainties,  estimation  is  necessary  to  solve  this  optimization  problem.  An 
adaptive  control  architecture,  named  LI  adaptive  control,  provides  a  framework  where 
uncertainty  estimates  can  be  used  to  solve  the  optimization  problem  if  we  consider  a  system  at 
steady  state.  LI  gain  of  a  linear  time-invariant  (LTI)  system  is  defined  as  the  LI  norm  of  its 
impulse  signal.  LI  adaptive  control  got  its  name  because  its  stability  condition  is  usually 
expressed  using  LI  gains. 

3.0  METHODS,  ASSUMPTIONS,  AND  PROCEDURES 
3.1  Problem  Formulation 

Consider  a  single-input  single  output  system  with  full  state  feedback, 

x(t)  =  AKx(t)  +  BukCi)  +  a(x,  t)  (1) 

x(0)  =  xo  =  0  (2) 

For  any  controllable  Ak,  B,  there  exists  K  G  R”  such  that  a  nominal  control  signal, 
-K^x(t)  stabilizes  the  system,  i.e.  Ak  -  BK^  is  Hurwitz.  We  can  then  represent  the  system  in  (1) 
as 


x(t)  =  Ax(t)  +  Bu(t)  +  a(x,  t)  (3) 

where  A  =  Ak  -  BK^  and  u(t)  =  ukCO  +  K\(t).  Because  a(x,t)  is  bounded,  this  system  is  still 
controllable  even  in  the  presence  of  these  uncertainties. 

The  control  objective  is  for  x(t)  to  maintain  a  give  constraint,  g(x)  =  0,  while 
simultaneously  minimizing  ||u(t)|p. 

3.2  Reference  Optimization 

To  achieve  the  control  objective,  we  determine  an  optimal  reference  point  at  every  time- 
instant.  The  time -history  of  these  reference  points  constitutes  a  reference  signal,  r(t),  for  the 
system  to  track.  To  determine  r(t),  we  first  assume  that  the  system  is  in  steady-state  and  tracking 
r(t).  This  allows  to  rewrite  (3)  as 
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0  =  Ar(t)  +  Bu(t)  +  a(r,t) 


(4) 


Solving  (4)  for  u(t)  yields 

u(t)  =  -B'^(Ar(t)  +  a(r,t)) 


and 

||u(t)||^  =  u(t)Vt)  =  (Ar(t)  +  a(r,t))^(B-yB-'(Ar(t)  +  a(r,t)) 


We  can  now  formulate  the  optimization  problem  as 

minr(t)  f(r(t))  =  (Ar(t)  +  a(r,t))^(B-i)'^B-yAr(t)  +  CT(r,t)) 
subject  to  g(r(t))  =  0 

To  solve  this  problem,  we  define  the  Lagrangian, 

L(r,v)  =  f(r(t))  +  vg(r(t)) 

The  optimal  r(t)  then  satisfies 


VL(r,v)  = 


2A'^(B-i)'^B-i(Ar(t)  +  CT(r,t))  +  v^' 
g(r(t)) 


=  0 


(5) 

(6) 

(V) 

(8) 

(9) 


(10) 


The  remaining  issue  is  that  a(r,t)  is  unknown.  To  account  for  this,  we  replace  a(r,t)  with 
an  adaptive  estimate,  CT(t).  Then  we  choose  r(t)  such  that 


VL(r,v)  = 


2A'^(B-i)'^B-i(Ar(t)  +  CT(r,t))  +  v^' 
g(r(t)) 


=  0 


(11) 


is  satisfied.  The  adaptive  law  that  generates  CT(t)  will  be  derived  in  the  following  section. 

3,3  Control  Algorithm 

The  control  algorithm  consists  of  a  state  predictor,  adaptive  law,  and  control  law. 

3,3,1  State  Predictor,  The  state  predictor  is  a  dynamic  system  designed  to  mimic  the  structure 
of  (3), 


x(t)  =  Ax(t)  +  Bu(t)  +  CT(t)  (12) 

3,3,2  Adaptive  Law,  The  adaptive  law  is  designed  to  drive  the  error  between  the  predicted  state 
and  the  real  state  to  zero.  To  do  this,  we  look  at  the  dynamics  of  the  prediction 
error,  x(t)  =  x(t)  —  x(t).  This  yields 
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x(t)  =  Ax(t)  +  a(t)  —  a(x,  t) 

The  solution  of  (13)  at  t  =  (i+l)T  is 

x((i  +  1)T)  =  e^^x(iT)  +  +  T)dT  —  IT  +  T)dT 


(13) 


(14) 

We  ehoose  a(t)  =  a(iT)  for  t  G  [IT,  (i+l)T).  This  allows  us  to  take  a  out  of  the  integral  in  (14). 
Sinee  a(x,t)  is  unknown,  we  negleet  its  effeets  for  the  seleetion  of  CT(t).  So  to  find  CT(iT),  we 
neglect  the  third  term  on  the  right-hand  side  of  (14)  and  set  x((i  -f  1)T)  =  0.  This  yields 

CT(iT)  =  —  e^’^x(iT)  (15) 

3.3.3  Control  Law.  The  control  law  is  designed  to  drive  x(t)  to  r(t).  This  combines  with 
adaptive  law  drives  x(t)  to  r(t).  The  first  part  of  the  control  law  is  designed  assuming  CT(t)  =  0. 
Then  we  simply  use  the  steady-state  gain, 

Ui(t)  =  -[A-iB]-ir(t)  (16) 

The  other  component  of  the  control  law  serves  to  cancel  the  effects  of  ^(t).  To  do  this,  we 
simply  choose  the  opposite  of  CT(t)  and  apply  a  low-pass  filter  to  compensate  for  the  effects  of 
the  high-gain  feedback  adaptive  law, 

U2(t)  =  -C(s)CT(t)  (17) 

The  total  control  law  is 

U(t)  =  Ui(t)  +  U2(t)  (18) 

3.4  Extension  to  Multi-Agent  Systems 

A  satellite  constellation  is  a  group  of  artificial  satellites  that  work  together  to  fulfill  some 
common  objectives.  Through  coordination,  the  constellation  members  can  fulfill  cooperative 
tasks  that  a  single  satellite  could  not.  For  example,  coordinated  ground  coverage  can  be  achieved 
such  that  constellation  members  overlap  well  in  coverage  and  complement  rather  than  interfere 
with  each  other.  A  second  example  is  to  coordinate  multiple  satellites  with  different  onboard 
sensors  to  extract  additional  information  about  a  sensed  target  using  sensor  fusion.  Maintaining 
reliable  communication  links  between  satellites  and  ground  stations  is  another  critical 
requirement  for  many  satellite  constellations. 

Consider  a  constellation  of  three  satellites.  The  dynamics  of  each  satellite  are  described  as 
follows  [1].  The  reference  coordinate  system  has  the  x-axis  pointing  toward  the  vernal  equinox 
and  the  z-axis  pointing  upwards.  The  right-hand  convention  defines  the  y-axis,  completing  the 
triad.  We  assume  that  the  earth  is  spherical  and  uniform.  The  satellite's  position  in  the  earth- 
centered  inertial  coordinates  should  satisfy  the  equation  of  motion. 
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r(t)  =  -  ^^(0  +  /(t)  +  w(t)  (19) 

where  ji  =  398,600  mVs,  r=  ||r||  is  the  distanee  between  the  satellite  and  the  eenter  of  the  earth. 
The  radial  eomponent  of  the  satellite's  veloeity  is  given  by  v^.  =  — ,  and  the  satellite’s  speeific 

angular  momentum  is  given  hy  h  —  r  x  v.  The  orbit’s  inelination  is  given  by  i  =  cos“^  (^)’ 
and  its  eecentricity  by 

e  =  -  ~  r)  ^  ~  rvy-v^  (20) 


fi  I 

The  longitude  of  the  ascending  node  is  given  by 

I  uu;'  ^ 

n 


cos  ^(n^) 


Uy  >  0 


(21) 


(JL) 


(22) 


V  = 


(23) 


2n  —  cos  ^(tLx)  riy  <  0 
and  the  argument  of  perigee  is  given  by 

cos“^  ^2  >  0 

2n  —  cos~^  <  0 

with  the  convention  that  o)  =  cos“^  for  an  equatorial  orbit.  The  true  anomaly  is  given  by 

cos“^  Vj-  >  0 

2n  —  cos~^  <  0 

with  the  convention  that  v  =  cos“^  for  a  circular  orbit.  The  eccentric  anomaly  is  given  by 

E  =  cos-1  (24) 

2 

where  a  =  j^.  The  mean  anomaly  is  given  hy  M  =  E  —  e  sin£',  and  the  orbit  period  is  given 

r 

by  r  —  271  I — .  The  position  of  the  satellite  is  fully  defined  by  the  parameter  set  [i,  Cl,  o),  T,  e,  v). 

The  angles  (i,  Cl,  o)}  transform  the  inertial  frame  to  the  orbital  frame,  T  and  e  define  the  size  and 
shape  of  the  orbit,  and  v  defines  the  satellite’s  position. 

For  the  purposes  of  this  project,  we  will  consider  two  types  of  disturbances  that  each  satellite 
may  be  subjected  to,  namely  atmospheric  drag  and  solar  radiation  pressure.  The  acceleration  due 
to  drag  can  be  modeled  as 

(25) 


^  2  ^  mv 


The  acceleration  due  to  the  solar  radiation  pressure  is  modeled  as 
/r  =  -Pr(1  +  c)  X  1  AU^ 

The  sum  of  the  disturbances  acting  on  each  satellite  in  (19)  is 

fit)  ^fo+fR 

The  dynamics  of  the  total  constellation  can  be  expressed  as 

Xj(t)  =  AjXj(t)  +  hjUj(t)  +  o-j(t),  i  =  1, 2, 3 

Vijit)  =  CijXi(t),  j  =  1,2,3 

where 


(26) 

(27) 

(28) 
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(29) 


[rxi 

^X1 

rx2 

rx3 

^x3V 

[^yl 

Vyl 

ry2 

^y2 

ry3 

^y3]^ 

^3  = 

Tzl 

^zl 

rz2 

^z2 

rz3 

^z3]^ 

and 

Qi  = 

[1 

0  0 

0 

0  0] 

Ci2  = 

[0 

0  1 

0 

0  0] 

Ci3  = 

[0 

0  0 

0 

0  1] 

for  all  i. 

We  do  not  model  the  aetuators  used  to  generate  the  thrust  for  eaeh  satellite.  Here,  we  will  simply 
assume  that  any  thrust  less  than  a  given  limit  ean  be  obtained  by  an  inner-loop  eontroller, 

^ij  —  ^max  (31) 

In  the  interest  of  fuel  eonservation,  eaeh  satellite  is  only  eontrolled  when  it  leaves  a  defined  error 
box  about  the  referenee  position.  The  error  box  is  larger  when  the  satellite  is  entering  it  than 
when  leaving  it.  We  have 

^ij,nom  -yt;|  >Ein  and  Yt\^ij-yij\  <  0 

-yi;|  >Ein  and  y  \Rij-yij\  >  0 

Uij  =  <  .  (32) 

0  if  \Rij-yij\  <  Bin  and  -  \Rij-yij\  <0 

,  0  if\Rij -yij\  <  Bin  and  ^jRij -yij\>0 

Finally,  the  eontrol  objeetive  is  for  all  three  satellites  to  maintain  an  equal  distribution  around  the 
earth  at  a  given  eonstant  altitude  and  in  the  same  orbital  plane. 

Since  all  individual  satellite  faces  uncertainties  and  disturbances  described  above,  same 
algorithm  can  be  implemented  as  distributed  controllers  for  individual  satellite  in  a  satellite 
constellation.  The  adaptive  algorithm  for  a  single  agent  described  in  3. 0-3. 3  can  be  implemented 
as  decentralized  controller.  The  only  modification  is  how  the  desired  reference  trajectories  will 
be  derived.  Eq.  (8)-(9)  will  be  revised  to  an  optimization  problem  in  the  multi-agent  framework. 
In  addition  to  fuel  cost,  cooperative  objective  will  also  be  considered. 


4.0  RESULTS  AND  DISCUSSION 


Figure  1  shows  simulation  results  for  a  system  with  the  parameters 

A=[°  M,T  =  0.0001,  C(s)  =  and  g(x)  =  xi +X2  +  50. 

—  I  — V2j  lO  iJ  '  V  y  s+100  ^  ^  ^ 
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200 


t  (sec) 

Figure  1,  Simulation  Results 


The  simulation  results  show  good  tracking  performance  while  r(t)  varies  according  to  the 
reference  optimization  algorithm.  Extension  to  multi-agent  systems  with  its  application  to 
satellite  constellation  is  under  further  investigation. 

5.0  CONCLUSIONS  AND  RECOMMENDATIONS 

5.1,  Conclusions,  This  report  presents  a  new  method  for  reference  trajectory  optimization  for 
use  with  the  LI  adaptive  control  architecture.  The  LI  formulation  specifically  lends  itself  to 
solving  the  optimization  problem  if  we  assume  the  system  is  in  steady  state.  Since  adaptive 
uncertainty  estimates  are  available,  we  can  substitute  the  estimates  into  the  optimization  problem 
in  order  to  find  the  solution  for  a  system  with  unknown  disturbances  and  modelling  uncertainty. 
The  simulation  results  show  that  the  controller  is  able  to  track  satisfactorily  whilst  updating  the 
reference  signal  according  to  the  reference  optimization  algorithm.  The  method  can  be  further 
extended  to  multi-agent  systems.  In  a  satellite  constellation,  reference  trajectory  can  be 
optimized  in  a  distributed  manner  using  multi-objective  optimization.  At  the  same  time,  each 
single  satellite  can  follow  optimized  reference  trajectories  individually. 

5.2,  Recommendations.  This  result  lends  itself  to  application  in  a  multi-agent  cooperative 
control  setting  and  specifically  the  problem  of  satellite  constellation  control.  In  this  framework, 
the  problem  formulation  is  similar  to  what  has  been  presented  here,  except  the  system  state  is 
composed  of  state  variables  from  multiple  independent  vehicles,  each  with  their  own 
decentralized  controllers.  Then  the  control  input  is  the  thrust  of  each  satellite,  and  minimizing  it 
is  equivalent  to  minimizing  fuel  usage  of  the  constellation. 

In  the  future  extension  to  satellite  constellation  control,  models  would  be  adopted  for 
gravitational  forces,  aerodynamic  drag,  and  solar  radiation  pressure.  Each  member  of  the 
constellation  would  operate  in  one  of  two  modes:  continuous  low-thrust  or  impulsive  high-thrust. 
The  continuous  low-thrust  mode  is  used  when  the  satellite  is  on  or  very  near  to  the  desired  orbit 
or  trajectory.  If  the  satellite  drifts  past  a  threshold  distance  away  from  the  desired  path,  the 
impulsive  high-thrust  mode  is  switched  on.  The  switching  logic  between  these  modes  may 
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introduce  additional  considerations  for  theoretical  algorithm  development.  Overall,  the  referenee 
optimization  eontroller  provides  a  rieh  basis  for  investigating  applieations  relevant  to  AFRL’s 
goals. 
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LIST  OF  SYMBOLS,  ABBREVIATIONS,  AND  ACRONYMS 


LI  Adaptive  control  architecture 
LTI  Linear  time-invariant 
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